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The  USAF  Armstrong  Laboratory  Human  Resources  Directorate  has  joint-service 
responsibility  for  development  of  measures  for  selection  and  classification.  This  effort 
contributes  a  methodology  for  deciding  what  measures  should  be  developed.  This  was 
accomplished  under  contract  F41689-88-D-0251,  Task  53  to  Metrica,  Inc.  with  principal 
investigator,  Dr.  W.E.  Driskill  and  monitored  by  James  A.  Earles,  AL/HRMIM. 


METHODOLOGY  FOR  IDENTIFYING  ABILITIES  FOR  JOB  SPECIALTIES  (MIDAS) 


I.  INTRODUCTION 


Background 

This  report  describes  a  methodology  for  assessing  ability  requirements  for  Air  Force 
occupational  specialties.  Initial  research  was  conducted  by  Driskill,  Weissmuller,  Hageman, 
and  Barrett  (1989).  This  research  reviewed  existing  methodologies  for  determining  ability 
requirements  from  occupational  analysis  data  reported  by  the  U.S.  Air  Force  Occupational 
Measurement  Squadron  (USAFOMS).  Specifically,  36  general  and  special  purpose  taxonomies 
previously  used  to  describe  job  or  worker  characteristics  were  identified  and  reviewed.  The 
Ability  Requirements  Scale  (ARS)  method  developed  by  Fleishman  and  Mumford  (1988)  was 
reconunended  as  being  the  most  appropriate  for  identifying  ability  requirements  of  Air  Force 
occupational  groups.  This  ARS  approach,  with  modification',  was  the  most  compatible  with 
existing  Ar  Force  occupational  ta^  analysis  data,  provided  the  most  extensive  coverage  of 
abilities,  and  gave  the  most  direct  link  with  tests  of  specific  abilities. 

Driskill  et  al.  (1989)  described  an  Occupational  Survey  Methodology  (OSM)  Abilities 
Requirements  Scale  (ARS)  approach  for  linking  the  verb  (the  action)  level  of  a  task  to  abilities 
across  jobs.  Job  analyses  have  been  completed  on  most  Ar  Force  jobs  using  an  Air  Force- 
developed  methodology  connected  to  a  set  of  program  subroutines  (Comprehensive 
Occupational  Data  Ansdysis  Programs,  CODAP).  It  was  suggested  that  where  USAFOMS 
occupational  analysis  data  did  not  exist  (some  Ar  Force  officer  specialties),  the  General  Work 
Inventory  (Ballentine  &  Cunningham,  1981)  could  be  used  as  an  alternative  to  the  action- verb 
approach  for  describing  work  performed.  Recommendations  for  follow-on  research  included 
a  pilot  test  study  of  this  verb-ability  taxonomy  involving  a  small  number  of  enlisted  and  officer 
specialties.  Specific  issues  to  be  addressed  as  part  of  this  pilot  test  included:  a)  the  reliability 
of  subject-matter-expert  judgement  about  ability  requirements  relative  to  action  verbs  and 
General  Work  Inventory  (GWI)  element  information,  b)  the  qualitative  similarity  of  judgements 
from  the  two  sources  of  descriptive  information  (verb  versus  GWI  element),  and  c)  the  degree 
to  ^^ch  specialties  are  differentiated  by  ability  ratings. 

In  addition,  the  study  suggested  that  use  of  a  mail  survey  approach  be  assessed. 
Typically,  the  ARS  is  group-administered  and  frequently  considerable  training  of  raters’  on 
meaning  of  abilities  and  rating  requirements  is  provided.  Group  administration  has  resulted 
in  useful  ability  ratings.  Such  administration,  given  the  number  of  Air  Force  specialties,  would 
be  resource-intensive  and  expensive.  Mail  survey  collection  of  ability  ratings  (if  found  to 
provide  useful  ratings)  could  be  far  less  resource-intensive. 


'  The  authors  pointed  out  that  ARS  taxonomy  utility  could  be  improved  for  Air  Force  use 
by  adding  selected  interpersonal  abilities  and  additional  psychomotor  abilities. 
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Dittmar  and  Ringenbach  (1991),  in  follow-on  research,  prepared  the  necessary  ground 
work  for  a  pilot  test  study  of  the  verb-ability  taxonomy.  Their  work  focussed  on  four  major 
objectives.  The  first  involved  the  identification  of  a  comprehensive  taxonomy  of  abilities 
applicable  to  successful  performance  of  work  within  Air  Force  specialties.  The  second 
concerned  the  selection  of  the  eight  specialties  (four  enlisted  and  four  officer)  to  be  surveyed. 
The  third  identified  verbs  and  GWI  elements  to  be  used  to  describe  the  work  performed  within 
the  eight  specialties.  The  last  objective  involved  the  development  of  the  prototype  survey 
instruments  to  be  used  to  elicit  ability  ratings  from  subject-matter  experts.  Following  is  a 
summary  of  the  work  performed  with  respect  to  each  of  these  four  objectives. 

A  literature  review  was  conducted  to  determine  the  cognitive,  perceptual,  psychomotor, 
and  interpersonal  ability  factors  that  could  be  used  in  the  Air  Force  setting.  The  primary 
source  of  reference  for  the  cognitive  and  psychomotor  domains  was  Theologus,  Romashko,  and 
Fleishman  (1970).  A  set  of  37  abilities,  including  the  definition  of  the  ability  and  task 
examples,  was  taken  from  this  work  to  be  included  in  the  Air  Force  abilities  taxonomy.  Other 
sources  of  reference  for  the  cognitive  and  psychomotor  domains  were  Siegel,  Federman,  and 
Welsand  (1980)  and  Carretta  (1990).  The  main  source  used  in  identifying  interpersonal 
abilities  was  a  factor  analytic  study  of  the  General  Work  Inventory  (Cunningham,  Wimpee,  & 
Ballentine,  1990).  The  complete  abilities  taxonomy  consisted  of  53  cognitive,  psychomotor, 
and  interpersonal  abilities. 

Although  this  set  of  53  abilities  formed  a  very  comprehensive  taxonomy,  it  was  too 
large  for  mailout  survey  application.  Additionally,  most  ability  definitions  were  thought  to  be 
too  complex  and  academically  oriented  for  practical  use  with  Air  Force  enlisted  and  officer 
populations.  As  a  result,  a  reduced  set  of  28  abilities  was  identified  for  "mailout"  purposes. 
This  set  consisted  of  15  cognitive,  6  psychomotor,  and  7  interpersonal  abilities.  The  primary 
rationale  used  to  select  these  abilities  was  the  identification  of  a  set  of  abilities  that  were  as 
distinct  as  possible  (i.e.,  minimum  overlap  among  abilities),  and  a  set  of  abilities  that  appeared 
to  have  some  potential  for  identifying  differences  among  the  Air  Force  specialties. 
Specifically,  this  reduced  set  included  those  that  could  be  related  to  the  verbal,  speed,  and 
quantitative  factors  thought  to  be  measured  by  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVAB),  and  to  spatial,  perceptual,  and  psychomotor  abilities  thought  to  be  important  for 
pilots.  Ability  definitions  for  this  reduced  set  were  also  simplified,  to  the  extent  possible,  to 
improve  respondent  understanding.  Appendix  A  is  this  reduced  set  of  abilities  and  their 
modified  definitions. 

Selection  of  the  eight  Air  Force  specialties  (AFSs)  to  be  surveyed  was  accomplished 
sequentially.  A  set  of  67  enlisted  and  19  officer  AFSs  surveyed  by  the  USAF  Occupational 
Measurement  Squadron  between  January  1986  and  February  1990  was  reviewed  to  eliminate 
those  AFSs  jointly  surveyed  and  those  with  less  than  400  members.  Second,  AFSs  with  less 
than  10  task  statement  verbs  accounting  for  80  percent  or  more  of  their  inventory  tasks,  and 
AFSs  with  more  than  25  verbs  required  to  account  for  80  percent  of  their  inventory  tasks  were 
also  eliminated  from  further  consideration.  The  final  set  of  eight  specialties  was  selected  to 
minimize  the  number  of  task  statement  verbs  conunon  across  specialties,  and  to  allow  MAGE 
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aptitude  group  representation  among  the  four  enlisted  areas  (mechanical  -  M,  administrative 
A,  general  -  G,  and  electronics  -  E).  Table  1  is  a  list  of  the  eight  specialties  selected. 


1  Table  1.  AFSs  Selected 

AFSC  (Aptitude)  | 

AFS  Title 

Enlisted  AFS 

271X2  (A45) 

Operations  Resources  Management 

411X2A  (E33) 

Missile  Facilities 

464X0  (M61/E46) 

Explosive  Ordnance  Disposal 

924X0  (G43) 

Medical  Laboratory 

Officer  AFS 

49XX 

Communications-Computer  Systems  Staff  Officer 

70XX 

Information  Management 

X-Prefix 

Flight  Safety  Officer 

1045/1055/1065/ 

1115/1235/1355 

Pilot 

Following  the  recommendations  of  Driskill  et  al.,  two  parallel  methods  of  describing 
the  work  performed  within  occupational  groups  (Air  Force  specialties)  were  used.  The  first 
of  these  two  methodologies  involved  the  use  of  task-statement  verbs  to  describe  work 
performed  (CODAP-based  method).  The  second  methodology  was  based  on  the  General  Work 
Inventory  (GWI)  and  involved  the  use  of  "work  elements"  to  describe  work  performed  (GWI- 
based  method). 

The  CODAP-based  method  focussed  on  the  identification  of  those  verbs  appearing  most 
frequently  in  the  task  inventories  of  the  AFSs  to  be  surveyed.  Verbs  were  first  ordered  on 
frequency  of  appearance  (most  frequently  appearing  verb  first),  then  selected  until  the  set  of 
verbs  selected  was  contained  in  at  least  80  percent  of  the  task  statements^  Table  2  specifies 
the  number  of  verbs  selected  within  each  AFS.  In  order  to  make  these  sets  of  verbs  more 


^  Prior  to  verb  selection,  survey  data  were  processed  to  eliminate  all  tasks  within  Duties 
A,  B,  C,  and  D  to  restrict  verb  selection  to  "technical"  tasks. 
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meaningful  to  survey  respondents,  verb  definitions  and  example  task  statements  were  also 
developed  for  each  verb^. 


1  Table  2.  Number  of  Verbs  Selected 

AFS 

1  Number  of  Verbs  Selected  ||  Percent  of  Task  Covered  | 

271X2 

18 

81% 

4IIX2A 

10 

93% 

464X0 

21 

80% 

924X0 

12 

86% 

49XX 

24 

80% 

70XX 

22 

84% 

X-Prefix 

17 

80% 

Pilot 

19 

80% 

The  GWI-based  method  involved  the  identification  of  "work  elements"  to  describe  the 
work  performed.  In  order  to  assess  the  relevance  of  the  268  work  elements  comprising  the 
GWI  with  respect  to  each  of  the  eight  AFSs,  the  GWI  was  first  administered  to  an  incumbent 
sample  within  each  specialty.  Table  3  shows  sample  sizes,  resulting  return  rates  and  interrater 
reliabilities  for  a  single  rater.  Survey  results  were  analyzed  to  select  those  "work  elements" 
considered  descriptive^  of  the  work  performed  within  each  AFS.  Each  selected  work  element 


^  A  maximum  of  15  example  task  statements  were  selected  for  each  verb.  When  more 
than  15  task  statements  containing  the  verb  of  interest  existed  in  the  task  inventory, 
stratified  random  sampling  (percent  member  performing  for  officer  AFSs  and  Task 
Learning  Difficulty  for  enlisted  AFSs)  was  used  to  select  the  15  tasks. 

*  Work  elements  rated  by  at  least  one-half  of  the  raters  within  a  specialty,  and  with  mean 
values  of  5  or  greater  (GWI  used  a  9-point  part-of-job  scale),  were  considered 
descriptive  of  the  work  performed. 
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was  then  converted  to  task  statement  form  for  clarity’.  Table  4  specifies  the  number  of  "work 
elements"  identified  for  each  of  the  eight  AFSs. 


Table  3.  GWI  Sample  Sizes,  Return  Rates,  and  Reliabilities 


AFS 

Sample  Size 

Surveys  Returned 
(Rate) 

R|i 

271X2 

70 

26  (37%) 

.39 

411X2A 

70 

34  (49%) 

.31 

464X0 

66 

32  (48%) 

.41 

924X0 

70 

33  (47%) 

.35 

49XX 

70 

39  (56%) 

.39 

70XX 

70 

25  (36%) 

.49 

X-Prefix 

74 

18  (24%) 

.40 

Pilot 

105 

25  (24%) 

.42 

■  .,1..  .  a-— 

Table  4.  Number  of  Work  Elements 

AFS 

Number  of  Work  Elements  Identifled 

271X2 

20 

411X2A 

26 

464X0 

35 

924X0 

39 

49XX 

21 

70XX 

24 

X-Prefix 

28 

Pilot 

24 

*  After  reviewing  the  8  sets  of  GWI  elements  selected,  it  appeared  that  the  use  of 
verbatim  element  descriptions  would  result  in  some  loss  of  meaning.  For  example, 
element  El 30,  "FLYING  VEHICLES  --  (Examples:  airplanes,  helicopters,  etc.),"  did 
not  appear  to  completely  describe  the  work  activity  of  interest.  It  seemed  that  the 
element  would  be  better  stated  by  combining  both  the  element  subsection  description 
"E-1.  Tools/Equipment/Machines  Used  or  Operated"  and  the  key  words  of  the  element 
to  form  a  task  statement  such  as  "Use  or  operate  flying  vehicles."  Therefore,  the 
selected  GWI  work  elements  descriptions  were  combined  with  element  subsection 
descriptions  to  form  task  statements. 
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Separate  prototype  survey  booklet  versions  were  developed  for  each  of  the  two  methods 
—  CODAP-based  and  GWI-based.  The  initial  prototype  versions  contained  a  single  section 
(Section  I)  designed  to  yield  "importance-of-ability"  ratings  for  given  verbs  (CODAP-based) 
or  given  task  statements  (GWI-based).  In  this  section,  incumbents  were  asked  to  assign  ability 
importance  ratings  to  each  verb  or  statement  using  an  absolute  11 -point  scale  (Highest 
Importance  =  0,  Lowest  Importance  =  10).  This  section  addressed  the  major  thrust  of  the 
research  —  assessing  ability  importance  across  occupational  groups.  Two  additional  sections 
were  eventually  added  to  these  prototype  survey  booklet  versions.  A  Section  II  was  added  to 
establish  baseline  ratings  with  respect  to  ability  level.  In  this  Section,  incumbents  were  asked 
to  use  a  7-pyint  scale  (7  =  Very  High  Ability  Level,  1  =  Very  Low  Ability  Level)  to  rate  the 
degree  to  which  each  of  the  28  abilities  included  in  the  taxonomy  was  possessed  by  the 
average  college  graduate  and  then  by  a  fully  qualified  officer  assigned  to  the  AFS  of  interest. 
For  the  enlisted  specialties,  incumbents  assigned  ratings  with  respect  to  the  average  high  school 
graduate  and  then  journeyman  (5-skill  level)  within  the  AFS.  It  was  hoped  that  the  resulting 
data  would  provide  additional  insight  not  only  into  selection  issues,  but  also  training  issues; 
i.e.,  large  differences  in  ability  level  between  the  average  high  school  graduate  and  the 
journeyman  could  imply  a  high  level  of  training  importance  for  the  ability.  A  Section  III  was 
also  added  as  a  potential  measure  of  verb  and  task  statement  relative  importance  in  terms  of 
consequences  of  inadequate  performance.  In  this  last  section,  incumbents  were  asked  to  assign 
percentage  ratings  to  each  verb  or  task  statement  reflecting  the  percentage  of  work  in  their 
career  field  that,  if  performed  incorrectly,  could  result  in  severe  injury  or  death.  It  was 
anticipated  that  the  resulting  data  could  be  used  to  enhance  the  assessment  of  ability 
importance  levels  across  the  Air  Force  specialties  sampled.  Appendix  B  provides  an  example 
of  a  CODAP  action  verb  task,  a  GWI  element,  the  abilities  rating  response  collection  page,  and 
the  11 -point  rating  scales. 

Scope 


This  current  research  effort  was  designed  to  meet  two  broad  objectives.  The  first  was 
refinement  of  the  previously  developed  prototype  survey  booklets.  The  second  was  the 
analysis  of  survey  results  from  a  tryout  of  survey  collections  in  the  eight  jobs. 

Prototype  survey  booklets  were  evaluated  during  a  series  of  small-group  administrations 
within  a  number  of  Air  Force  specialties  (AFSs).  Of  primary  concern  was  the  assessment  of 
the  clarity  of  survey  instructions,  survey  administration  time,  and  overall  suitability  of  survey 
formats  for  mailout  application.  Survey  booklet  refinements  were  made  on  the  basis  of  small- 
group  administration  results. 

Analysis  of  survey  results  was  designed  to  address  a  number  of  important  questions. 
The  first  dealt  with  the  degree  to  which  raters  agreed  on  ability  requirements  with  respect  to 
given  verbs  and  GWI  element  task  statements.  The  second  area  of  investigation  concerned  the 
extent  to  which  the  AFS  samples  differed  with  regard  to  ability  requirements  and  the  validity 
of  those  reported  requirements.  The  third  involved  the  extent  to  which  identical  verbs  and 
identical  GWI  elements  tended  to  represent  similar  ability  sets.  The  remaining  area  of  concern 
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addressed  the  comparability  of  AFS  ability  requirements  derived  from  the  CODAP-  and  GWI- 
based  approaches. 


Report  Organization 

Section  II  of  this  report  describes  survey  instrument  refinement  efforts  (small-group 
administration  and  resulting  instrument  changes).  Section  III  details  mailout  sample  selection 
procedures  and  the  survey  mailout  process.  Section  IV  reports  data  analysis  findings.  Section 
V  is  a  discussion  of  results,  and  Section  VI  contains  recommendations  for  future  research. 


II.  SURVEY  INSTRUMENT  REFINEMENT 


A  series  of  five  pilot  tests  (small-group  survey  administration)  was  conducted  to 
evaluate  and  refine  the  prototype  survey  instruments.  Table  5  lists  the  Air  Force  specialties 
(AFSs)  surveyed,  number  of  personnel  surveyed  (N),  and  the  location  and  dates  of  pilot  tests. 


1  Table  5.  Pilot  Tests 

1  1  N 

Location/Date 

1  464X0 

4 

Lackland  AFB/5  June  1991 

70XX 

2 

Brooks  AFB/11  July  1991 

70XX 

2 

Randolph  AFB/24  July  1991 

49XX 

2 

Randolph  AFB/5  August  1991 

Pilot 

4 

Randolph  AFB/25  October  1991 

AFS  464X0  Administration 

This  initial  pilot  test  was  conducted  in  a  highly  interactive  manner;  incumbents’ 
perceptions  were  actively  solicited  throughout  the  survey  administration  process.  Two  of  the 
incumbents  completed  the  General  Work  Inventory  (GWI)  version  of  the  survey  and  two 
incumbents  completed  the  task-statement  verb  (CODAP)  version.  Administration  times  for 
both  versions  exceeded  2  hours.  Incumbents  appeared  to  have  little  trouble  understanding  and 
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using  the  abilities  taxonomy*.  However,  all  incumbents  reported  difficulty  in  using  the  11- 
point,  importance-of-ability  scale^  associated  with  the  prototype  survey  instruments. 

AFS  70XX  Administration 

Administration  time  for  both  survey  versions  again  exceeded  2  hours.  Both  incumbents 
found  the  1 1 -point  scale  usable  but  initially  confusing.  Both  felt  that  the  survey  instrument  in 
its  present  form  would  be  quite  time-consuming  to  complete.  Incumbents  were  especially 
concerned  that  Section  III  of  the  survey  instrument*  appeared  very  difficult  to  understand  and 
complete. 

AFS  70XX  Administration  (D 

With  Section  III  removed,  survey  administration  time  for  both  versions  still  exceeded 
1  hour.  One  of  the  incumbents  again  expressed  concerns  with  respect  to  the  complexity  of  the 
11 -point  scale. 

AFS  49XX  Administration 

Administration  time  for  both  versions  was  approximately  2  hours.  The  incumbents 
found  the  1 1 -point  scale  difficult  to  understand  and  use.  More  importantly,  they  felt  that  these 
surveys  would  be  very  difficult  to  complete  if  received  by  mail. 

Survey  Instrument  Revision 

Given  the  results  of  these  four  pilot  tests,  two  major  problems  were  obvious.  The  first 
concerned  the  utility  of  the  11 -point  importance-of-ability  scale.  The  second  problem  was 
excessive  survey  administration  times.  Almost  all  incumbents  found  the  importance-of-ability 
scale  difficult  to  understand  and  use.  After  evaluating  a  number  of  scale  alternatives,  a 
simplified,  9-point  scale  (9  =  extremely  high  importance,  1  =  extremely  low  importance)  was 
adopted.  This  scale  was  simplified  to  remove  anchors  to  a  given  percentage  of  tasks  or  actions 


®  The  abilities  taxonomy  (Abilities  List)  associated  with  the  prototype  surveys  consisted 
of  a  set  of  28  defined  abilities  with  behavioral  examples  describing  high,  moderate,  and 
low  levels  of  each  ability. 

’  The  11 -point,  importance-of-ability  scale  (0  =  the  highest  importance,  10  =  the  lowest 
importance)  used  with  the  prototype  survey  instruments  was  designed  to  be  an  absolute 
scale.  Each  scale  point  was  anchored  to  a  given  percentage  of  tasks  or  actions  that 
could  be  successfully  performed  by  individuals  with  average  levels  of  the  ability  of 
interest. 

*  Section  III  of  the  prototype  survey  booklet  was  designed  to  elicit  ratings  regarding  the 
impact  of  incorrect  performance  of  verbs  or  actions. 
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that  could  be  successfully  performed  by  individuals  with  average  ability  levels.  Additionally, 
scale  numbering  was  reversed  to  equate  high  importance  with  high  scale  numbers  and  low 
importance  with  low  scale  numbers.  Appendix  C  shows  the  9-point  rating  scale. 

In  order  to  reduce  survey  administration  time,  the  following  instrument  revisions  were 
made.  First,  Section  III  of  both  the  task-statement  verb  (CODAP)  and  GWI  survey  versions 
was  eliminated.  It  was  felt  that  the  value  of  the  ratings  (assessment  of  the  impact  of  incorrect 
task  performance)  elicited  by  this  section  did  not  justify  the  difficulty  and  time  associated  with 
its  completion.  Second,  task-statement  verb  (CODAP)  versions  were  modified  to  limit  the 
number  of  verbs  to  be  rated  to  10  and  to  limit  the  number  of  associated  example  task 
statements  to  a  maximum  of  5*.  Finally,  GWI  versions  were  modified  to  limit  the  number  of 
GWI  task  statements  to  be  rated  to  a  maximum  of  25'®. 

Pilot  Administration 


Revised  survey  instniments  for  both  versions  were  administered  to  four  incumbents. 
Average  administration  time  for  each  version  was  approximately  1  hour.  All  incumbents  found 
the  revised  9-point  scale  easy  to  use.  Additionally,  all  thought  that  the  revised  surveys  could 
be  successfully  administered  by  mail. 


III.  SAMPLE  SELECTION 


Two  samples  of  N  =  100  were  drawn  where  possible.  Sample  selection  for  the  enlisted 
Air  Force  Specialties  (AFSs)  was  restricted  to  7-sWll  levels"  assigned  to  the  CONUS,  with 
dates  of  separation  later  than  9203  and  no  pending  personnel  actions  (i.e.,  PCS,  school 
assignments,  etc.).  Sample  selection  for  the  officer  specialties  was  restricted  to  0-3s'^ 
assigned  to  the  CONUS  with  no  pending  personnel  actions. 


’  The  10- verb  sets  were  selected  on  descending  cumulative  percent  time  spent  on  tasks 
using  the  verb.  Example  tasks  were  selected  on  descending  percent  members 
performing  (PMP). 

Where  GWI  task-statement  sets  associated  with  prototype  versions  exceeded  25,  task 
statements  with  the  lowest  peirt-of-job  values  were  eliminated. 

"  Where  sufficient  numbers  of  7-skill  levels  did  not  exist,  samples  were  supplemented 
with  5-skill  levels. 

Where  sufficient  numbers  of  0-3s  did  not  exist,  samples  were  supplemented  with  0-2s 
and  then  0-4s. 
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IV.  ANALYSIS  OF  RESULTS 


Survey  Return  Rates 

The  average  survey  return  rate  across  occupational  groups  and  survey  version  was  32 
percent  Table  6  lists  return  rates  by  occupational  group  and  survey  version. 


T|il|>le  Sum 

^  Return  Rates  ( 

^  A^^  1  Survey  Version  { 

Sample  N 

1  Return  Rates 

271X2 

CODAP 

100 

31% 

GWI 

100 

27% 

411X2A 

CODAP 

100 

33% 

GWI 

100 

36% 

464X0 

CODAP 

100 

39% 

GWI 

100 

23% 

924X0 

CODAP 

100 

34% 

GWI 

100 

28% 

49XX 

CODAP 

100 

44% 

GWI 

100 

33% 

70XX 

CODAP 

100 

34% 

GWI 

100 

33% 

X-Prefix* 

CODAP 

82 

36% 

GWI 

83 

36% 

Pilot 

CODAP 

100 

21% 

GWI 

100 

23% 

1  *  Population  size  was  not  sufficient  to  allow  samples  of  100. 

Reliabilities 


Rater  reliabilities  were  calculated  using  GRPREL,  a  subroutine  of  CODAP.  Interrater 
reliabilities  for  a  single  rater  (R,,)  and  for  each  composite  of  N  raters  (Rkk)  calculated 
for  each  verb  and  GWI  statement  within  each  Air  Force  specialty  (AFS).  Table  7  contains  a 
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summary  of  these  reliabilities  for  each  AFS.  Overall,  reliabilities  appeared  to  be  satisfactory 
for  both  methods,  with  no  clear  superiority  with  respect  to  either  method. 


Table  7.  Reliability  Estimates 


AFS  (Method) 

Rkk 

Range  |  Median 

Range 

1  Median 

271X2  (verb) 

.16  -  .43 

.23 

.86  -  .95 

.90 

271X2  (GWI) 

.08  -  .44 

.385 

.71  -  .95 

.94 

411X2A  (verb) 

.15  -  .34 

.21 

.85  - .93 

.90 

411X2A  (GWI) 

.06  -  .41 

.17 

.69  -  .95 

.88 

464X0  (verb) 

.12  -  .38 

.15 

.82  -  .95 

.88 

464X0  (GWI) 

.10  -  .59 

•41 

.74  -  .97 

.94 

924X0  (verb) 

.13  -  .59 

.28 

.83  -  .98 

.93 

924X0  (GWI) 

.10  -  .56 

.34 

.82  -  .97 

.92 

49XX  (verb) 

.29  -  .50 

.435 

.94  -  .98 

.97 

49XX  (GWI) 

.14  -  .53 

.42 

.84  -  .97 

.95 

70XX  (verb) 

.16  -  .49 

.45 

.86  -  .97 

.96 

70XX  (GWI) 

.12  -  .49 

.38 

.82  -  .96 

.95 

X-Prefix*  (verb) 

.37  -  .50 

.44 

.95  -  .97 

.96 

X-Prefix*  (GWI) 

.13  -  .50 

.27 

.81  -  .96 

.92 

Pilot  (verb) 

.18  -  .38 

.28 

.83  -  .93 

.885 

Pilot  (GWI) 

.12  -  .50 

.345 

.80  -  .96 

.925 

Factor  Structures 


As  an  initial  step,  an  in-house  factor  analysis  program,  MAX-FACTOR,  was  used  to 
reduce  both  the  CODAP-based  (verbs)  and  the  GWI -based  (elements)  data  sets  in  order  to 
compare  their  respective  factor  structures.  This  was  done  to  determine  whether  similar  factors 
emerged  from  the  two  data  sets,  and  the  extent  to  which  they  discriminated  among  the  eight 
occupational  groups  (AFSs). 


Mean  ability  ratings  were  computed  for  each  of  the  81  verb/rater  sets.  This  process 
yielded  a  vector  of  28  means  (one  for  each  ability  contained  in  the  taxonomy)  for  each  of  the 
81  verb/rater  sets.  Pearson  correlations  were  then  calculated  between  each  pair  of  vectors  to 
form  an  81  X  81  matrix  of  intercorrelations.  Similarly,  a  vector  of  mean  ability  ratings  was 
computed  for  each  of  the  189  GWI  element/rater  sets.  The  correlation  between  each  pair  of 
these  vectors  was  also  calculated  to  form  a  189  X  189  matrix  of  intercorrelations.  Both 
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nu^cM  woe  thm  subjected  to  [uiiicipal  &ctors  factor  analysis  and  VARIMAX  rotation. 
Table  8  contain  the  reailting  eigenvalue  and  tbe  associated  percent  of  variance  for  vdiich  th^ 
accounted.  Table  9  and  10  list  factors  with  loadings  of  at  least  .50,  along  with  jM^dominant 
abilitie  for  verbs  and  elements,  respectively. 


1 _ 

1  CODAP-Based 

1  GWI^ased  | 

1  Eigenvalue 

Percent  Variane 

Eigenvalue 

Percent  Vari¬ 
ance 

40.5 

50.1 

104.4 

55.2 

12.9 

16.0 

27.8 

14.7 

8.9 

11.0 

22.7 

11.9 

4.3 

5.3 

6.7 

3.5 

2.5 

3.1 

5.0 

2.7 

1.7 

2.1 

3.4 

1.8 

1.4 

1.8 

2.9 

1.7 

1.1 

1.4 

2.4 

1.3 

1.8 

.9 

1.6 

.8 

1.5 

.8 

1.3 

.7 

Total  Variance 

90.8 

96.0  1 
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TABLE  9.  FACItm  STRUCnntE  (VCKBS)  (COMtaMd) 
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FACTCm  SntUCTVRE  (ELEMENTS) 


TABLE  II.  FACTOR  STRUCTURE  (ELEMENTS)  (Coatimcd) 


(X-Prefix) 


FACTOR  STRUCTURE  (ELEMENTS)  (CoalfaiMd) 


tABLC  It.  FACTOR  STRUCTURE  (ELEMENTS)  (CoMtaiaMl) 


Of  the  eight  factors  extracted  from  the  CODAP-based  (verbs)  data  set,  five  had  factor 
loadings  of  .50  or  greater'^  (Table  9).  Factor  1  appears  to  be  a  verbal  factor  characterized 
by  VE  (Verbal  Expression).  Officer  AFSs  (70XX,  49XX,  and  X-Prefix)  seem  to  be 
differentiated  by  this  factor  to  a  greater  extent  than  the  enlisted  specialties  or  Pilot.  Verbs  one 
would  expect  to  have  face  validity  with  respect  to  a  factor  characterized  by  verbal  expression 
(advise,  write,  draft)  tend  to  have  high  factor  loadings.  Factor  2  appears  to  be  somewhat  more 
heterogeneous  in  that  loadings  are  associated  with  number  facility  and  reasoning  abilities  in 
addition  to  information  ordering  and  verbal  comprehension.  Enlisted  specialties  (271X2, 
924X0,  464X0,  and  41 1X2 A)  seem  to  be  differentiated  by  this  factor.  Relatively  high  loadings 
associated  with  the  verbs  "Input,"  "Audit,"  "Calculate,"  and  "Record"  give  this  factor  a 
mathematical/information-ordering  flavor.  Factor  3  has  a  clear  technical  flavor,  and  is 
characterized  by  psychomotor  abilities  such  as  finger  dexterity,  static  strength,  and  arm-hand 
steadiness.  The  tluee  enlisted  specialties  differentiated  (41 1X2 A,  924X0,  and  464X0)  tend  to 
be  more  "maintenance"-oriented  than  AFS  271X2  (Operations  Resources  Management)  or  the 
officer  specialties.  High  loadings  on  the  verbs  "Install,"  "Remove,"  "Service,"  and  "Adjust" 
support  this  contention.  Factor  4  uniquely  represents  both  the  cognitive  and  the  psychomotor 
abilities  associated  with  the  Pilot  specialty.  Factor  5  appears  to  be  unique  to  AFS  464X0 
(Explosive  Ordnance  Disposal)  and  seems  to  aptly  describe  this  specialty  in  terms  of  the  ability 
requirements  of  originality,  reasoning,  and  working  effectively  in  imcomfortable  human 
situations.  Factors  6,  7,  and  8  were  not  interpreted,  given  the  lack  of  factor  loadings  of  .50  or 
greater. 


Of  the  12  factors  extracted  from  the  GWI-based  (elements)  data  set,  9  had  loadings  of 
.50  or  greater  (Table  10).  Factor  1  appears  to  be  a  quantitative/reasoning  factor  characterized 
by  MR  (Mathematical  Reasoning),  DR  (Deductive  Reasoning),  10  (Information  Ordering),  and 
NF  (Number  Facility).  Elements  B12  (Receive  or  use  information  in  the  form  of  numbers  or 
math  symbols)  and  B14  (Receive  or  use  information  in  the  form  of  tables,  graphs,  or  charts) 
have  the  highest  factor  loadings.  There  seems  to  be  no  apparent  discrimination  among  the 
eight  occupational  groups.  Factor  2  is  clearly  verbal  in  nature  and  is  characterized  by  VE 
(Verbal  Expression)  and  VC  (Verbal  Comprehension).  Elements  B19  (Speak  using 
conversational  English)  and  B20  (Speak  using  formal  English)  have  the  highest  loadings  on 
this  factor.  Again,  there  does  not  appear  to  be  substantial  discrimination  among  occupational 
groups  with  respect  to  this  factor.  Factor  3  is  associated  with  psychomotor  abilities  — 
primarily  FD  (Finger  Dexterity)  and  AH  (Arm-Hand  Steadiness).  Elements  El  16  (Use  or 
operate  keyboard  equipment  other  than  computing  devices),  El  17  (Use  or  operate  office 
machinery  or  equipment  except  keyboard  and  computing  devices),  and  El 22  (Use  hand-held 
writing,  drawing,  or  marking  devices)  have  high  loadings.  No  obvious  pattern  of  discrimina¬ 
tion  among  occupational  groups  can  be  detected.  Factor  4,  with  moderate  loadings  on  E176 
(Provide  medical  or  health  treatment  or  care),  El 74  (Inspect  equipment,  products,  or  facilities), 
and  B53  (Use  information  about  individuals  such  as  resumes  or  job  performance  ratings),  is 


”  Only  factors  with  loadings  equal  to  or  greater  than  .50  were  interpreted.  Where  more  than  20  percent 
of  loadings  for  any  factor  exceeded  .50,  only  the  highest  20  percent  are  displayed  in  Tables  9  and  10. 
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difficult  to  interpret.  At  best,  this  factor  can  be  char^terized  as  relating  to  interperson* 
al/reasoning  abilities  loosely  related  to  AFSs  924X0  (Medical  Laboratory)  and  X-Preftx  (Safety 
Officer).  Factor  5  is  clearly  cognitive/psychomotor  in  nature  and  is  characterized  by  SO 
(Spatial  Orientation),  CRT  (Choice  Reaction  Time),  and  TS  (Time-Sharing).  High  loadings 
on  element  El 30  (Use  or  operate  flying  vehicles)  tend  to  support  a  "pilot"  orientation.  Factor 
6  was  not  interpreted,  given  the  lack  of  factor  loadings  of  .50  or  greater.  Factor  7  is  a 
psychomotor  factor  involving  CRT  (Choice  Reaction  Time)  and  MC  (Multilimb  Coordination) 
and  appears  related  to  El 27  (Use  or  operate  highway  vehicles)  and  El 28  (Use  or  operate  off¬ 
road  vehicles).  Both  AFS  464X0  (Explosive  Ordnance  Disposal)  and  AFS  41 1X2 A  (Missile 
Facilities)  tend  to  be  associated  with  this  factor.  Personnel  within  these  AFSs  use  vehicles 
extensively  in  their  work.  Factor  8  appears  to  be  related  to  V  (Visualization)  and  DR 
(Deductive  Reasoning),  with  a  high  loading  on  element  B16  (Receive  or  use  information  in  the 
form  of  drawings,  pictures,  and  diagrams).  This  factor  seems  to  be  important  for  AFS  49XX 
(Communications-Computer  Systems  Officer)  and  AFS  464X0  personnel.  Factor  9  seems  to 
be  interpersonal  in  nature  and  is  characterized  by  A  (Assuming  Responsibility)  and  WE 
(Working  Effectively  in  Uncomfortable  Human  Situations).  This  factor  seems  to  be  unique 
to  AFS  411X2A  personnel,  with  its  highest  loading  on  element  El 73  (Watch  or  monitor 
machines  or  equipment).  Factor  10  also  appears  to  be  interpersonal  in  nature  (Assuming 
Responsibility)  and  has  its  highest  loadings  on  B35  (Stock  or  inventory  materials,  tools,  or 
equipment)  and  El 59  (Transport  products,  material,  or  people  from  one  place  to  another). 
Factors  11  and  12  were  not  interpreted,  given  the  lack  of  factor  loadings  of  .50  or  greater. 

Comparisons  of  the  CODAP-based  (verbs)  and  GWI-based  (elements)  factor  structures 
reveal  both  similarities  and  differences.  Both  structures  contain  a  strong  verbal  factor  (Factor 
1  for  verbs  and  Factor  2  for  elements).  Both  structures  also  contain  a  quantitative/reasoning 
factor  (Factor  2  for  verbs  and  Factor  1  for  elements).  Factor  3  in  both  structures  represents 
psychomotor  abilities.  Factor  4  (verbs)  and  Factor  5  (elements)  appear  to  represent 
cognitive/psychomotor  abilities  associated  with  the  Pilot  occupational  group.  The  remaining 
factors  within  both  structures  appear  to  be  some\^at  unique  and  relate  abilities  to  individual 
or  pmrs  of  occupational  groups  (AFSs).  Primary  differences  between  the  two  factor  structures 
tend  to  be  associated  with  the  efficiency  with  which  occupational  groups  are  discriminated. 
For  example,  the  verbal  factor  associated  with  verbs  (Factor  1)  appears  to  distinguish  between 
officer  and  enlisted  personnel  to  a  greater  extent  than  the  verbal  factor  associated  with  elements 
(Factor  2).  Similarly,  the  quantitative  reasoning  factor  associated  with  verbs  (Factor  2)  seems 
to  distinguish  between  enlisted  and  officer  personnel  to  a  greater  extent  than  the  quantita¬ 
tive/reasoning  factor  associated  with  elements  (Factor  1).  The  same  can  be  said  for  Factor  3 
of  both  structures.  These  differences  may  be  a  function  of  the  broader,  more  general  nature 
of  the  elements  of  the  GWI,  or  a  function  of  how  the  GWI  was  used  in  this  study‘s.  Since 


Only  a  subset  of  the  268  work  elements  contained  in  the  complete  GWI  were  used  to  elicit  ability 
taxonomy  importance  ratings  (see  footnotes  4  and  S).  This  subset  consisted  primarily  of  Section  B 
(Information  Elements)  and  Section  E  (Physical  Activities).  Other  subsets  of  the  GWI  such  as  Sensory 
requirements.  General  Mental  Requirements,  and  interpersonal  Activities  were  not  used,  to  avoid  overlap 
with  the  abilities  taxonomy.  Logistical  considerations  also  made  it  impossible  to  ask  respondents  to  rate 
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the  GWl  approach  (elements)  appears  to  yield  less  distinct  information  relative  to  ability 
differences  among  occupational  groups,  remaining  analysis  efforts  will  focus  primarily  on  the 
CODAP  approach  (verbs). 

A  gross  comparison  between  the  "verbs”  factor  structure  and  those  factor  structures 
reported  for  the  Armed  Services  Vocational  Aptitude  Battery  (ASVAB)  (Welsh,  Kucinkas,  & 
Curran,  1990),  Air  Force  Officer  Qualifying  Test  (AFOQT)  (Skinner  &  Ree,  1987),  and  Basic 
Attributes  Test  (BAT)  (Carretta,  1990)  can  be  summarized  as  follows.  Carretta  (1990)  reported 
a  six-factor  solution  for  the  BAT.  Of  these,  factor  one  was  defined  by  complex  coordination 
tracking  error  scores;  and  factors  three  and  four,  as  components  of  information  processing 
speed.  These  three  factors  would  seem  to  relate  to  Factor  4  of  the  "verbs"  structure  which 
tends  to  be  characterized  by  Pilot-related  abilities  of  Spatial  Orientation,  Time  Sharing,  Choice 
Reaction  Time,  and  Information  Ordering.  However,  Carretta’ s  factor  two  (finger  dexterity) 
appears  unrelated  to  this  "verbs"  factor.  Of  the  six  AFOQT  factors  defined  by  Skinner  and  Ree 
(1987),  "verbal",  "quantitative",  and  "space  perception"  would  seem  to  be  related  to  Factors  1, 
2,  and  4,  respectively,  of  the  "verbs"  structure.  Of  the  "verbal,"  "speed,"  "technical,"  and 
"quantitative"  factors  comprising  the  current  ASVAB  versions  (Welsh  et  al.,  1990),  verbal  and 
quantitative  factors  are  clearly  represented  within  the  "verbs"  factor  structure. 

Primary  differences  are  characterized  by  Factor  3  of  the  "verbs"  structure,  which  is 
associated  with  psychomotor  abilities  such  as  Finger  Dexterity,  Arm-Hand  Steadiness,  and 
Static  Strength,  and  has  no  comparable  counterpart  within  either  ASVAB-or  AFOQT-reported 
factor  structures.  Although  Factor  1  of  the  "verbs"  structure  is  similar  to  the  verbal  factors  of 
the  ASVAB  and  AFOQT,  its  focus  appears  to  be  more  narrow.  Factor  1  of  "verbs"  tends  to 
be  highly  related  to  the  Verbal  Expression  ability.  Verbal  factors  associated  with  ASVAB  and 
AFOQT  tend  to  be  somewhat  broader  and  defined  in  terms  of  Word  Knowledge  (WK)  and 
Paragraph  Comprehension  (PC),  and  of  Verbal  Analogies,  Reading  Comprehension,  and  Word 
Knowledge,  respectively. 

Ability  Mean  Comparisons 

An  examination  of  differences  in  mean  ability  importance  ratings'*  for  the  eight 
occupational  groups  (Table  11)  tends  to  show  a  number  of  meaningful  differences.  On  the 
officer  side,  the  above  average  cognitive  and  psychomotor  ability  pattern  depicted  for  the  Pilot 
specialty  appears  to  be  highly  appropriate  in  that  high  importance  is  assigned  to  those  abilities 


each  of  268  elements  with  respect  to  ability  importance.  If  all  268  work  elements  had  been  used,  it  is 
possible  that  the  factor  structure  associated  with  elements  would  have  been  different  from  the  one 
described  above. 

'*  The  mean  ability  ratings  contained  in  Table  1 1  are  limited  to  those  values  that  exceed 
the  grand  mean  for  a  given  ability  by  .5  or  greater.  These  values  represent  raw  means. 
The  use  of  raw  mean  values  as  opposed  to  standardized  values  is  considered  appropriate 
given  the  "absolute"  nature  of  the  rating  scale  used. 
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that  one  would  expect  to  be  fundamental  for  flying  aircraft.  A  comparison  of  these  Pilot 
abilities  with  those  of  the  nonflying  officer  specialties'^  also  reflects  logical  differences. 
Nonrated  officers  appear  to  feel  that  cognitive  and  interpersonal  abilities  such  as  Verbal 
Expression,  Persuading/Influencing,  Assuming  Responsibility,  Empathy,  Verbal  Comprehen¬ 
sion,  and  Originality  are  important.  This  set  of  abilities  rated  high  by  nonflying  personnel 
seem  to  be  extremely  important  for  effective  performance  of  Air  Force  officers  in  general.  It 
should  be  noted  that  among  these  abilities.  Originality,  Persuading/Influencing,  Assuming 
Responsibility,  and  Empathy  are  not  directly  assessed  by  current  officer  selection  measures. 

Mean  ability  importance  ratings  among  the  four  enlisted  specialties  are  even  more 
distinct.  The  AFS  271X2  (Operations  Resources  Management)  ability  importance  ratings 
pattern  reflects  a  strong  numerical/speed  orientation  characterized  by  high  ability  ratings  with 
respect  to  Number  Facility,  reasoning,  and  speed.  These  abilities  are  quite  similar  to  those 
associated  with  the  Administrative  (A45)  aptitude  requirement  of  this  AFS.”  The  AFS 
411X2A  (Missile  Facilities  Maintenance)  mean  ability  importance  ratings  pattern  is  essentially 
psychomotor  in  nature.  The  abilities  rated  as  important  (Static  Strength,  Finger  Dexterity, 
Arm-Hand  Steadiness,  and  Multilimb  Coordination)  appear  to  have  little  in  common  with  the 
Electronics  composite'*  (E33)  used  to  select  personnel  into  this  career  field.  The  high 
strength  aptitude  (K/70  lbs)  associated  with  this  specialty  does,  however,  relate  to  the  high 
rating  on  the  Static  Strength  ability.  Given  that  AFS  41 1X2 A  is  the  only  true  "maintenance" 
specialty  contained  in  the  sample  of  occupational  groups  used  for  this  study,  it  is  not  surprising 
that  high  psychomotor  ability  ratings  distinguish  this  occupational  group  from  the  others.  It 
also  should  be  noted  that  these  psychomotor  abilities  are  not  currently  measured  by  the 
ASVAB.  AFS  924X0  (Medical  Laboratory)  is  best  characterized 


'*  The  X-Prefix  occupational  inventory  used  with  this  study  contained  those  duties  and 
tasks  associated  with  safety/accident  investigation  activities,  not  flying  activities. 

Administrative  (A)  is  a  composite  of  NO  (Numerical  Operations),  CS  (Coding  Speed) 
and  VE  (Verbal  Expression). 

'*  E  is  composed  of  AR  (Arithmetic  Reasoning),  MK  (Mathematics  Knowledge),  El 
(Electronics  Information),  and  GS  (General  Science  )  ASVAB  Subtest  Scores. 
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by  absence  of  any  meaningful  ability  pattern  (only  Finger  Dexterity  appears  to  have  above 
average-importance).  The  General  (G43)  aptitude  requirement  associated  with  this  specialty 
tends  to  some  extent  to  support  this  nonpattem  finding.  AFS  464X0  (Explosive  Ordnance 
Disposal),  on  the  other  hand,  is  characterized  by  a  pattern  of  above-average  ability  importance 
ratings  across  the  spectrum  of  cognitive,  psychomotor,  and  interpersonal  abilities.  Given  the 
complex  nature  of  the  aptitude  requirements  needed  for  entry  into  this  career  field  (M60  and 
E46),  this  pattern  of  obtained  ability  importance  ratings  is  not  surprising. 

Profiles  (Figure  1)  of  mean  ability  importance  ratings  for  Pilot,  officer  specialties 
(X-Prefix,  49XX,  and  70XX),  and  enlisted  specialties  are  also  as  one  would  expect.  Officer 
ability  patterns  tend  to  be  higher  with  respect  to  verbal  and  selected  interpersonal  abilities,  and 
low  with  respect  to  psychomotor  and  selected  spatial  and  perceptual  cognitive  abilities. 
Enlisted  specialties  tend  to  differ  from  officer  specialties  on  verbal  (lower)  and  psychomotor 
(higher)  abilities.  Pilot  remains  distinct  chiefly  as  a  result  of  the  importance  of  those  cognitive 
and  psychomotor  abilities  related  to  flying. 

The  profiles  may  also  be  interpreted  in  light  of  scales.  The  middle  score,  5,  is  a  level 
of  ability  required  of  the  average  high  school  graduate  for  enlisteds  (college  for  officers)  given 
adequate  training  and  experience.  Verbal  Comprehension  had  a  mean  rating  of  S.l  for  enlisted 
and  S.8  for  officers,  and  Verbal  Expression  had  a  mean  rating  of  S.8  for  officers.  All  fifiy- 
three  other  mean  ratings  were  below  a  score  of  5. 


Cluster  Analysis 

As  an  adjunct  to  the  factor  analysis  performed  on  the  "verbs"  and  "elements"  data  sets, 
and  to  obtain  a  clearer  indication  of  the  extent  to  which  like  verbs  and  elements  tended  to 
group  together,  the  Comprehensive  Occupational  Data  Analysis  Programs  (CODAP)  programs 
OVRLAP,  GROUP,  and  DIAGRM  were  used  to  compute  and  map  cluster  solutions  for  the 
verbs  and  elements  data  sets.  Specifically,  OVRLAP  was  used  to  calculate  overlap  values  for 
ability  importance  ratings  for  each  pair  of  verbs  or  elements.  The  resulting  similarity  matrix 
of  overlap  values  was  then  clustered  using  GROUP.  DIAGRM  was  used  to  map  the  resulting 
solutions.  Figure  2  is  the  "verbs"  cluster  solution,  and  Figure  3  is  the  solution  for  elements. 

f 

The  verbs  cluster  solution  (Figure  2)  can  best  be  described  specifically  in  terms  of  seven 
major  groups  encompassing  six  stages.  Stage  14  (I  and  11)  tends  to  include  die  nonrated  officer 
group  (X-Prefix,  49XX,  and  70XX).  This  stage  is  characterized  by  high  Verbal  Expression 
and  Verbal  Comprehension  ability  importance  ratings  and  corresponds  to  the  officer  profile 
depicted  in  Figure  1.  Verbs  such  as  Write/Draft,  Prepare,  Review,  Develop,  and  Conduct 
group  together  and  account  for  approximately  one-half  of  the  30  verbs  associated  with  this 
stage.  Stage  19  (III)  includes  most  of  the  verbs  associated  with  the  Pilot  specialty  and  is 
characterized  by  high  Spatial  Orientation  and  Visualization  ability 
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Figure  1.  Officer,  Pilot,  and  Enlisted  Ability  Mean  Profiles 
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Figure  2.  Cluster  Solution  for  Verbs  (Continued) 
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Figure  3.  Cluster  Solution  for  Elements 
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Figure  3.  Ouster  Solution  for  Elements  (Continued) 
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importance  ratings.  Stage  31  (IV)  is  dominated  by  verbs  associated  with  AFS  271X2;  and 
Stage  44  (V),  by  verbs  associated  with  AFS  464X0.  These  two  stages  are  similar  with  respect 
to  high  Verbal  Comprehension,  Deductive  Reasoning,  and  Information  Ordering  ability 
importance  ratings.  They  tend  to  differ  with  respect  to  the  relatively  high  importance  assigned 
by  AFS  464X0  personnel  to  the  Working  Effectively  in  Uncomfortable  Human  situations. 
Stage  15  (VI)  is  characterized  by  verbs  related  to  AFS  411X2A  and  relatively  high  importance 
ratings  on  psychomotor  abilities  (Arm-Hand  Steadiness,  Finger  Dexterity,  and  Multilimb 
Coordination).  Stage  10  (VII)  is  loosely  related  to  AFS  924X0  verbs  and  does  not  appear  to 
be  characterized  by  any  distinct  ability  importance  pattern.  In  gross  terms,  the  verbs  cluster 
solution  can  be  described  in  terms  of  Stage  14  (Verbal  Expression,  Verbal  Comprehension, 
Assuming  Responsibility)  containing  verbs  associated  with  nonrated  officers,  and  Stage  7 
(Verbal  Comprehension,  Information  Ordering,  Deductive  Reasoning)  containing  verbs 
associated  with  the  remaining  five  occupational  groups.  Only  in  Stage  14  does  there  appear 
to  be  consistent  grouping  of  like  verbs.  Overall,  the  cluster  solution  appears  to  be  driven  more 
by  occupational  group  ability  importance  differences  than  by  ability  importance  similarities 
associated  with  like  verbs. 

The  element  cluster  solution  (Figure  3)  can  be  described  in  terms  of  eighteen  groups 
encompassing  six  stages.  Stage  21  (I,  II,  and  III)  contains  elements  that  received  high 
importance  ratings  on  psychomotor  abilities  such  as  Finger  Dexterity  and  Arm-Hand 
Steadiness.  Elements  associated  with  this  stage  tend  to  be  those  related  to  operating  or 
maintaining  equipment  ranging  from  flying  vehicles  to  office  equipment.  Stage  36  (IV  through 
VIII)  includes  elements  rated  high  on  reasoning  abilities  and  Verb^  Comprehension.  Elements 
represent  those  associated  with  understanding  and  evaluating  written  information.  Stage  48  (IX 
and  X)  contains  elements  with  relatively  high  importance  ratings  on  a  set  of  cognitive  and 
psychomotor  abilities  (Reasoning,  Verbal  Comprehension,  Finger  Dexterity,  Information 
Ordering).  Included  elements  are  related  to  using  mechanical  and  electronic  information,  and 
operating  data  processing  devices  such  as  computers.  Stage  19  (XI)  contains  a  set  of  relatively 
unique  elements  involving  the  use  of  mathematical  information  to  solve  numerical  problems. 
These  elements  are  characterized  by  high  importance  ratings  on  Mathematical  Reasoning, 
Number  Facility,  and  Deductive  Reasoning.  Stage  12  (XII  through  XVII)  incorporates 
elements  that  received  high  importance  ratings  on  verbal  abilities  (Verbal  Expression  and 
Verbal  Comprehension).  These  elements  have  to  do  with  the  organization  and  use  of  verbal 
materials  and  their  production.  Stage  1 1  (XVIII)  tends  to  be  associated  with  elements  related 
to  the  use  of  tools  and  is  characterized  by  high  importance  ratings  on  psychomotor  abilities 
(Finger  Dexterity,  Arm-Hand  Steadiness,  and  Multilimb  Coordination).  Overall,  like  elements 
appear  to  be  more  closely  related  than  were  verbs  (Figure  2).  However,  element  groupings  did 
not  seem  to  represent  clear  patterns  of  occupational  group  differences  to  the  extent  noted  for 
verbs. 


30 


Comparison  of  Ability  Levels 


Section  II  of  both  survey  booklet  versions  (CODAP  and  GWI)  required  incumbents  to 
use  a  7-point  scale  (7  =  Very  High  Ability  Level,  1  =  Very  Low  Ability  Level)  to  rate  the 
degree  to  which  each  of  the  28  abilities  comprising  the  taxonomy  was  possessed  by  selected 
groups  (average  college  graduate  and  fully  qualified  officer  for  officer  specialties;  and  average 
high  school  graduate  and  journeyman  for  enlisted  specialties).  Evaluation  of  ability-level 
differences  between  the  designated  groups  within  each  specialty  indicated  that  the  greatest 
ability-level  differences  occurred  for  Assuming  Responsibility  and  Working  Effectively  in 
Uncomfortable  Human  Situations.  This  finding  was  consistent  across  both  survey  versions  and 
occupational  groups.  These  two  interpersonal  abilities”  are  not  currently  measured  by 
existing  selection/classification  instruments. 


V.  DISCUSSION 


This  study  was  designed  to  assess  four  fundamental  questions.  The  first  dealt  with  the 
degree  to  which  reliable  ability  importance  ratings  could  be  obtained  from  subject-matter 
experts  via  smvey  mailout.  The  second  concerned  the  extent  to  which  the  obtained  ability 
importance  ratings  differentiated  among  the  eight  occupational  groups,  and  the  validity  of  the 
resulting  rating  patterns.  The  third  area  of  investigation  centered  on  the  degree  to  which 
identical  verbs  and  GWI  elements  tended  to  represent  similar  ability  sets.  The  final  question 
addressed  the  comparability  of  ability  requirements  derived  from  the  CODAP-based  (verbs)  and 
GWI-based  (elements)  approaches. 

Obtained  rater  reliabilities  were  satisfactory.  Median  values  (interrater  reliabilities 
for  each  composite  of  N  raters)  ranged  from  .88  to  .97,  with  all  but  three  at  least  .90.  These 
results  indicate  that  reliable  ability  importance  information  can  be  obtained  from  subject-matter 
experts  using  survey  methodology.  TTiese  findings  also  imply  that  survey  booklet  formats  and 
the  associated  9-point  importance-of-ability  scale  functioned  properly.  The  reported  survey 
return  rate  across  occupational  groups  of  32  percent  indicated  that  survey  completion  was  not 
overly  burdensome  for  survey  respondents,  especially  given  mailout  timing  (i.e.,  during  holiday 
periods). 

Ability  importance  ratings  based  on  verbs  (CODAP  approach)  seemed  to  clearly 
differentiate  among  occupational  groups;  the  GWI  approach  appeared  to  be  less  effective  at  this 
differentiation.  Analysis  of  mean  importance  ratings  based  on  verbs  yielded  distinct  ability 
patterns  across  occupational  groups  and  between  sets  of  occupational  groups.  Among  the 


”  R,,  values  for  differences  ranged  from  .10  for  AFS  271X2  (Verbs)  to  .42  for  AFS 
70XX  (Verbs),  with  a  median  of  .20. 
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office  q)ecialties,  diffemices  in  ability  importance  ratings  were  noted  between  rated  and 
nonrated  q)ecialties.  Clear  di£f«ences  were  also  detected  among  the  enlisted  specialties,  and 
between  the  sets  of  officer  and  enlisted  specialties.  More  importantly,  the  obtained  pattern  of 
ability  ratings  for  each  occupational  group  2q)peared  to  have  at  least  face  validity.  Additionally, 
sets  of  psychomotor,  interpersonal  and  costive  abilities  not  currently  measured  by  the 
ASVAB  or  AFOQT  were  identified  among  those  abilities  rated  as  important  for  successful 
performance  within  occupational  groups. 

Evaluation  of  both  factor  and  cluster  analysis  solutions  for  verbs  (CODAP-based), 
tended  to  show  some  grouping  of  like  verbs  with  respect  to  specific  abilities  (e.g.,  "vmte"  and 
"draft"  were  associated  with  a  verbal  ability  factor,  and  "audit"  and  "calculate"  were  associated 
with  a  quantitative  factor).  For  the  most  part,  however,  the  cluster  solution  tended  to  be  driven 
by  occupational  group  differences.  On  the  other  hand,  there  appeared  to  be  a  greater  tendency 
for  like  elements  (GWI-based)  to  group  together  with  respect  to  specific  abilities.  This  is 
probably  a  fimction  of  the  broad  nature  of  the  element  task  statements  used  and  the  high 
frequency  of  element  overlap  across  occupational  groups.  Additionally,  the  absence  of  strong 
differentiation  among  occupational  groups  for  the  GWI  approach  may  have  tended  to  facilitate 
the  grouping  of  like  elements. 

Although  CODAP-based  (verbs)  and  GWI-based  (elements)  data  sets  tended  to  yield 
comparable  factor  structures,  the  extent  to  which  occupational  groups  were  differentiated  by 
these  two  approaches  was  markedly  different.  Ability  importance  patterns  based  on  "verbs" 
clearly  distinguished  occupational  groups.  Distinctions  in  ability  importance  patterns  based  on 
"elements"  were  minimal.  The  "less  clear"  occupational  distinctions  associated  with  the  GWI- 
based  approach  may  be  a  function  of  the  broad  nature  of  the  element  statements  used,  or  a 
function  of  eliciting  ability  importance  ratings  on  restricted  subsets  of  GWI  elements  (using 
the  complete  set  of  268  elements  would  have  been  logistically  impossible).  Whatever  the 
cause,  the  GWI  approach  does  not  seem  to  be  a  suitable  substitute  for  the  CODAP-based 
approach  if  we  assume  that  differing  jobs  indeed  require  differing  abilities  for  their  successful 
accomplishment. 


VI.  RECOMMENDATIONS  FOR  FUTURE  RESEARCH 


Based  on  study  results,  continuation  of  this  line  of  research  appears  to  be  merited.  This 
future  research  should  focus  on  the  enhancement  and  broader  application  of  the  CODAP-based 
approach. 

Among  those  research  areas  requiring  further  investigation  is  the  role  of  task  statement 
objects  (focus  of  action  verbs)  and  associated  task  factor  data  in  distinguishing  meaningful 
levels  of  specific  abilities  required  for  successful  performance  within  and  across  occupational 
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groups.  Current  study  results  indicate  that  verbs  can  be  used  to  elicit  meaningful  data  with 
respect  to  abilities  required  for  occupational  groups.  What  is  unknown  at  this  point  is  how 
much  (what  level)  of  any  given  ability  is  necessary  for  successful  performance.  Eliciting 
ability  ratings  from  verbs  matched  with  selected  sets  of  objects  may  yield  the  level-of-ability 
information  required.  For  example,  successfully  troubleshooting  an  inertial  navigation  system 
may  require  more  reasoning  auility  than  troubleshooting  an  electrical  relay.  Within  an 
occupational  group,  this  should  not  be  difficult  to  assess.  However,  determining  differences 
in  reasoning  ability  level  needed  to  troubleshoot  an  inertial  navigation  system  as  opposed  to 
a  fuels  system  involves  comparisons  across  occupational  groups  and  is  a  much  more  complex 
issue.  Comparisons  of  this  type  require  a  common  metric  such  as  that  used  to  make  task 
learning  difficulty  comparisons  (benchmark  learning  difficulty)  among  specialties.  It  is 
possible  that  the  benchmark  learning  difficulty  indices  associated  with  select^  object  sets  can 
be  used  to  provide  further  insight  into  differences  in  ability-level  requirements  across 
specialties. 

An  alternative  approach  to  assessing  differences  in  required  ability  levels  involves  the 
relationship  between  verb/object  sets  and  the  imderlying  knowledges  required  for  successful 
performance.  It  may  be  more  practical  to  identify  categories  of  knowledges  required  to 
perform  verb/object  sets  and  then  relate  the  knowledge  categories  to  ability-level  differences. 
The  methodologies  for  linking  verb/object  combinations  to  knowledge  taxonomies  have  been 
developed  and  successfully  tested  in  concurrent  Laboratory  research  efforts. 

Given  that  only  one  true  "maintenance"  specialty  (AFS  41 1X2 A)  was  included  among 
the  occupational  groups  surveyed  as  part  of  this  current  research,  future  field  testing  should  be 
expanded  to  encompass  a  much  wider  range  of  specialties.  At  a  minimum,  a  number  of 
aircraft  maintenance  specialties  from  both  electronics  and  mechanical  aptitude  areas  should 
be  studied  and  compared  with  respect  to  ability  requirements. 
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This  is  the  ability  to  understand  language,  both  individual  words  as  well  as  words  as  they 
appear  in  sentences  and  paragraphs. 

EXAMPLES:  (1)  Understand  a  mortgage  contract  for  a  new  home  (HIGH 

LEVEL). 

(2)  Understand  a  ne>\^aper  article  in  the  society  section  reporting 
on  a  recent  party  (MODERATE  LEVEL). 

(3)  Understand  a  comic  book  (LOW  LEVEL). 


2.  VERBAL  EXPRESSION 


This  is  the  ability  to  use  language  (either  oral  or  written)  to  communicate  information  or  ideas 
to  other  people. 

EXAMPLES:  (1)  Write  a  Pulitzer  prize  novel  (HIGH  LEVEL). 

(2)  Write  a  job  recommendation  for  a  subordinate  (MODERATE 
LEVEL). 

(3)  Cancel  newspaper  delivery  by  telephone  (LOW  LEVEL). 


3.  NUMBER  FACILITY 


This  is  the  ability  to  perform  numerical  operations  quickly  and  accurately;  for  example,  add, 
subtract,  multiply,  and  divide. 

EXAMPLES:  (1)  Compute  the  volmne  of  coal  ore  in  portions  of  a  mine  using 

survey  notes  (HIGH  LEVEL). 

(2)  Check  accuracy  of  restaurant  bill  against  the  prices  listed  in  the 
menu  and  then  recompute  the  bill  (MODERATE  LEVEL). 

(3)  Add  2  and  7  (LOW  LEVEL). 
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I  4.  MATHEMATICAL  REASONING  | 


This  is  the  ability  to  reason  abstractly  using  mathematical  concepts  and  symbols  in  order  to 
change  a  problem  described  in  words  into  a  solvable  mathematical  equation. 


EXAMPLES: 


(1)  Determine  mathematics  for  simulating  a  lunar  approach  and 
landing  (fflGH  LEVEL). 

(2)  Review  farm  production  records  to  determine  appropriate 
summary  statistics  (MODERATE  LEVEL). 

(3)  As  a  cashier  in  a  dime  store,  understand  how  to  "make  change" 
(LOW  LEVEL). 


INDUCTIVE  REASONING 


This  is  the  ability  to  find  the  most  appropriate  general  concepts  or  rules  N\iuch  Ht  sets  of  data 
or  which  explain  how  a  given  series  of  individual  items  are  related  to  each  other.  It  involves 
the  ability  to  logically  proceed  from  individual  cases  to  general  principles. 


EXAMPLES: 


(1)  Develop  a  model  reflecting  all  of  the  factors  which  contribute  to 
presidential  election  results  (HIGH  LEVEL). 


(2)  Forecast  manpower  or  material  needs  of  a  growing 
pharmaceutical  company  based  on  past  performance 
(MODERATE  LEVEL). 


(3)  Given  a  set  of  books  to  arrange,  one  determines  the  best  system 
is  fiction  and  non-fiction  (LOW  LEVEL). 


6.  DEDUCTIVE  REASONING 


This  is  the  ability  to  apply  general  concepts  or  rules  to  specific  cases  or  to  proceed  from  stated 
premises  to  their  logical  conclusions. 


EXAMPLES: 


(1) 

(2) 

(3) 


Design  an  aircraft  wing  using  the  principles  of  aerodynamics 
(HIGH  LEVEL). 

What  factors  you  would  take  into  account  planning  your  vacation 
to  Mexico  (MODERATE  LEVEL). 


Decide  whether  or  not  to  take  an  umbrella  (LOW  LEVEL). 


A-2 
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7.  MEMORIZATION 


[ 

This  is  the  ability  to  memorize  and  retain  new  information  which  occurs  as  a  regular  or  routine 
part  of  the  task. 


EXAMPLES:  (1)  After  examining  21  pictures  of  common  objects,  each  paired  with 

a  2-digit  number  for  4  minutes,  write  the  appropriate  number 
under  each  picture  when  they  are  presented  in  a  different  order 
(HIGH  LEVEL). 


(2)  Memorize  the  names  and  locations  of  all  the  African  countries 
so  that  when  an  outline  map  is  presented,  the  countries  can  be 
correctly  labeled  (MODERATE  LEVEL). 

(3)  Memorize  a  3-digit  combination  for  a  gym  locker,  including  both 
the  numbers  and  direction  (LOW  LEVEL). 


8.  INFORMATION 
ORDERING 


This  is  the  ability  to  apply  rules  in  order  to  arrange  information  into  the  best  or  most 
appropriate  sequence.  The  types  of  information  considered  under  this  ability  include  numbers, 
letters,  words,  pictures,  procedures,  sentences,  and  mathematical  or  logical  operations. 

EXAMPLES:  (1)  Determine  the  appropriate  sequence  of  checkout  procedures  for 

the  Apollo  rocket  (HIGH  LEVEL). 

(2)  Outline  the  schedule  of  work  for  a  housing  project,  given  a  list 
of  activities  to  be  done  (MODERATE  LEVEL). 


(3)  Arrange  a  group  of  people  by  height  (LOW  LEVEL). 


A-3 

39 


9.  TIME-SHARING 


This  is  the  ability  to  between  two  or  more  sources  of  information.  The  information 
obtained  from  these  sources  is  either  combined  and  used  as  a  whole,  or  is  retained  and  used 
separately. 


EXAMPLES:  (1)  Air  traffic  controller  monitors  radar  scope  to  keep  track  of 

inbound  and  outbound  planes  during  a  period  of  heavy, 
congested  traffic  (HIGH  LEVEL). 


(2)  Playground  director  supervises  SO  children  ^\^o  are  engaging  in 
many  different  activities  (MODERATE  LEVEL). 

(3)  A  short  stop  watches  the  lead  of  the  runner  on  second  and 
actions  of  the  pitcher  (LOW  LEVEL). 


10.  FLEXIBILITY  OF  CLOSURE 


This  is  the  ability  to  "hold  in  mind"  a  particular  visual  pattern  and  then  find  it  embedded  in 
distracting  material. 


EXAMPLES:  (1)  Spot  a  chameleon  in  high  grass  (HIGH  LEVEL). 

(2)  Find  5  camouflaged  birds  in  a  picture  (MODERATE  LEVEL). 


(3)  Upon  arriving  at  a  cocktml  party,  visually  identify  your  friends 
(LOW  LEVEL). 


SPEED  OF  CLOSURE 


This  is  the  ability  to  quickly  combine  and  organize  a  set  of  apparently  different  elements  into 
a  single,  meaningful  pattern  or  configuration. 

EXAMPLES:  (1)  Process  information  concerning  an  unidentified  aircraft  in  air 

defense  systems  (HIGH  LEVEL). 

(2)  When  presented  with  10  drawings,  each  containing  parts  of  an 
object  being  portrayed  (e.g.,  a  camera),  write  down  the  name  of 
each  of  the  10  objects  (Time  limit  -  3  minutes)  (MODERATE 
LEVEL). 


(3)  While  listening  to  the  radio,  recognize  and  start  to  hum  an 
"oldie"  after  hearing  the  first  few  notes  (LOW  LEVEL). 
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12.  PERCEPTUAL  SPEED 

This  is  the  ability  to  quickly  find  figures,  make  comparisons,  or  carry  out  other  tasks  involving 
visual  perception. 


EXAMPLES:  (1)  Review  25  purchase  requests  in  2  minutes  to  ensure  that  a 

purchase  order  number  is  included  on  each  form  (HIGH 
LEVEL). 


(2)  Estimate  the  diameters  of  20  logs  to  the  nearest  1/2  foot  in  10 
minutes  in  order  to  set  the  saw  speed  (MODERATE  LEVEL). 

(3)  Nursery  man  makes  25  fairly  easy,  gross  estimates  of  distance 
before  planting  25  shrubs  to  be  evenly  spaced  every  3  to  4  feet 
(LOW  LEVEL). 


13.  SPATIAL  ORIENTATION 


This  is  the  ability  to  maintain  orientation  with  respect  to  objects  in  space  or  to  comprehend  the 
position  of  objects  in  space  with  respect  to  your  position. 


EXAMPLES:  (1)  Be  aware  of  your  orientation  upon  awakening  in  a  gravity-free 

environment  (e.g.,  space  craft  in  orbit)  (HIGH  LEVEL). 

(2)  Use  a  road  map  to  find  your  way  through  a  major  city  (e.g., 
Boston),  given  that  you  have  never  been  there  before 
(MODERATE  LEVEL). 


(3)  Locate  specific  constellations  in  the  sky  (LOW  LEVEL). 


14.  VISUALIZATION 


This  is  the  ability  to  manipulate  or  transform  the  visual  images  of  spatial  patterns  or  objects 
into  other  spatial  arrangements. 


EXAMPLES:  (1)  Design  a  new  building  for  a  college  campus,  determining  how 

well  it  would  go  with  and  complement  the  other  architectural 
styles  on  campus  (HIGH  LEVEL). 

(2)  Imagine  what  your  living  room  would  look  like  if  you  wanted  to 
rearrange  the  furniture  (MODERATE  LEVEL). 


(3)  Imagine  how  to  put  paper  in  the  typewriter  so  the  letterhead  is 
at  the  top  (LOW  LEVEL). 
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15.  ORIGINALITY 


This  is  the  ability  to  produce  unusual  or  clever  responses  related  to  a  given  topic  or  situation 
or  to  improvise  solutions  to  problems  or  to  develop  procedures  in  situations  where  standard 
operating  procedures  do  not  apply. 

EXAMPLES:  (1)  Research  chemist  invents  new  synthetic  fiber  (HIGH  LEVEL). 

(2)  Design  a  bookcase  using  only  bricks  and  boards  so  that  it  is  both 
attractive  and  functional  (MODERATE  LEVEL). 

(3)  Auto  mechanic  adjusts  the  carburetor  idle  by  using  a  dime  in 
absence  of  a  screwdriver,  after  co-worker  suggested  something 
thin  (LOW  LEVEL). 


TH  I 


16.  STATIC  STRENGTH 


This  is  the  ability  to  exert  muscular  force  against  fairly  immovable  or  heavy  external  objects 
in  order  to  lift,  push,  or  pull  that  object. 

EXAMPLES:  (1)  Load  5  full  50-gallon  oil  drums  into  a  truck  (HIGH  LEVEL). 

(2)  Push  a  stalled  car  to  the  side  of  the  road  (MODERATE  LEVEL). 

(3)  Push  an  empty  shopping  cart  (LOW  LEVEL). 


17.  FINGER  DEXTERITY 

This  is  the  ability  to  make  skillful,  coordinated  movements  of  the  fingers  where  manipulations 
of  objects  may  or  may  not  be  involved. 

EXAMPLES:  (1)  Play  a  classical  flamenco  piece  on  the  guitar  (HIGH  LEVEL). 

(2)  String  a  badminton  racket  with  new  strings  (MODERATE 
LEVEL). 

(3)  Put  coins  in  a  parking  meter  (LOW  LEVEL). 
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18.  ARM-HAND  STEADINESS 


This  is  the  ability  to 
strength  and  speed  are 


make  precise,  steady  arm-band  positioning  movements  where  both 
minimized. 


EXAMPLES: 


(1)  Surgeon  makes  an  incision  into  the  heart  (HIGH  LEVEL). 

(2)  Pluck  eyebrows  (MODERATE  LEVEL). 

(3)  Point  at  a  sign  (LOW  LEVEL). 


19. 


MULTILIMB  COORDINATION 


This  is  the  ability  to  coordinate  the  movements  of  two  or  more  limbs  (e.g.,  two  legs,  two 
hands,  one  leg,  and  one  hand). 


EXAMPLES: 


(1)  Juggle  3  rubber  balls  (HIGH  LEVEL). 

(2)  Knit  a  sweater  (MODERATE  LEVEL). 

(3)  Clap  your  hands  (LOW  LEVEL). 


20.  CHOICE  REACTION  TIME 


This  is  the  ability  to  quickly  pick  the  right  action  that  goes  with  a  given  condition  when  several 
different  actions  can  be  selected. 

EXAMPLES:  (1)  In  a  space  craft  out  of  control,  an  astronaut  has  time  to  choose 

only  1  of  5  possible  corrective  actions  in  two-thirds  of  a  second 
(HIGH  LEVEL). 


(2)  Operate  a  busy  switchboard  where  you  start  to  answer  each  call 
in  1  second  on  the  average  (MODERATE  LEVEL). 

(3)  Select  the  correct  fork  in  the  road  when  the  road  sign  is  located 
at  the  center  of  the  fork  itself  and  where  you  have  1  second  to 
make  your  choice  (LOW  LEVEL). 
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21.  RATE  CONTROL 


This  is  the  ability  to  make  timed,  anticipatory  muscular  movements  to  intercept  or  follow  a 
continuously  moving  object  whose  speed  and/or  direction  vary  in  an  unpredictable  fashion. 


EXAMPLES;  (1)  Use  a  highly  sensitive  control  knob  to  keep  a  2-inch  circle 

around  a  target  which  varies  in  speed  and  direction  on  a  TV 
screen  (HIGH  LEVEL). 

(2)  Adjust  your  rhythm  of  work  to  the  conveyor  belt  speed  which 
randomly  varies  in  speed  from  1  to  3  inches  per  second 
(MODERATE  LEVEL). 


(3)  Ride  a  bicycle  alongside  a  runner  (LOW  LEVEL). 


22.  PERSUADING/INFLUENCING 


This  is  the  ability  to  get  others  to  think  or  act  as  you  would  like  them  to,  without  force  or 
coercion. 


EXAMPLES:  (1)  Convince  a  jury  that  your  client  is  innocent  (HIGH  LEVEL). 


(2)  Lobby  a  state  legislator  for  a  new  law  (MODERATE  LEVEL). 


(3)  Change  a  friend’s  mind  about  attending  a  social  function 
(LOW  LEVEL). 


23.  COOPERATING 


This  is  the  ability  to  work  with  others  in  a  cooperative  manner  to  complete  tasks  or  achieve 
goals  within  both  small-and  large-group  settings  requiring  teamwork. 

EXAMPLES:  (1)  Co-author  a  book  or  technical  report  (HIGH  LEVEL). 

(2)  Serve  as  a  member  on  a  staff  committee  (MODERATE 
LEVEL). 


(3)  Work  as  a  member  of  a  crew  (LOW  LEVEL). 


\  24,  ASSUMING  RESPONSIBILITY 


This  is  the  ability  to  assume 
others. 


responsibility  for  the  productivity,  behavior,  or  well-being  of 


EXAMPLES:  (1)  Being  responsible  for  the  well-being  and  productivity  of  a 

large  group  of  personnel  (HIGH  LEVEL). 

(2)  Being  a  team  leader  (MODERATE  LEVEL). 

(3)  Accepting  responsibility  for  one’s  own  behavior  (LOW 
LEVEL). 


25.  WORKING  EFFECTIVELY  IN 
ISOLATION  SETTINGS 


This  is  the  ability  to  work  productively  in  limited  personal  contact  situations. 


EXAMPLES:  (1)  Manning  an  isolated  listening  post  for  a  30-day  period  (HIGH 

LEVEL). 


(2) 


Guarding  aircraft  on  a  flight  line  (MODERATE  LEVEL). 


(3)  Driving  a  truck  alone  (LOW  LEVEL). 


26.  WORKING  EFFECTIVELY  IN 
UNCOMFORTABLE  HUMAN  SITUATIONS 


This  is  the  ability  to  work  productively  in  situations  where  people  are  angry,  distressed,  or 
tense. 


EXAMPLES:  (1)  Work  effectively  in  situations  where  there  are  injured  or  dying 

individuals  (HIGH  LEVEL). 


(2)  Work  effectively  in  situations  where  mistakes  can  cause  injury 
or  death  to  others  (MODERATE  LEVEL). 


(3)  Work  effectively  for  a  supervisor  who  is  often  hostile  or 
overly  aggressive  (LOW  LEVEL). 
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27.  EMPATHY 


This  is  the  ability  to  place  yourself  in  the  situation  of  others  and  to  be  able  to  understand 
how  they  are  feeling. 


EXAMPLES: 


(1)  Sign  over  some  of  your  sick  days  to  a  co-worker  who  is 
having  major  medical  problems  (HIGH  LEVEL). 

(2)  Work  on  your  day  off  so  your  co-worker  can  go  to  a  wedding 
of  a  close  friend  (MODERATE  LEVEL). 

(3)  Offer  the  use  of  your  pick-up  truck  to  a  young  co-worker  who 
cannot  afford  to  rent  a  U-haul  (LOW  LEVEL). 


□ 


28.  SELF-ASSESSING 


This  is  the  ability  to  evaluate  one’s  own  performance,  capabilities,  and  accomplishments. 

EXAMPLES;  (1)  Determine  whether  you  have  the  skills  and  knowledges 

necessary  to  apply  for  a  higher  level  job  (HIGH  LEVEL). 

(2)  Critique  your  own  performance  during  a  game  of  tennis 
(MODERATE  LEVEL). 

(3)  List  the  important  things  you  have  accomplished  during  the 
work  week  (LOW  LEVEL). 
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EXABiPLE:  ACTION  VERB  (CODAP) 

FLY:  To  operate  an  aircraft. 

Fly  two  ship  extended  formation  as  wingman 
Fly  two  ship  close  formation  as  wingman 
Fly  two  ship  extended  formation  as  lead 
Fly  two  ship  close  formation  as  lead 


EXAMPLE:  GWI  ELEMENT 


USE  OR  OPERATE  FLYING  VEfflCLES 


(COLLECTION  PAGE) 


ABILITIES _ 

COGNITIVE 

_ ABILITIES _ 

1.  Verbal  Comprehension 

2.  Verbal  Expression 

3.  Number  Facility 

4.  Mathematical  Reasoning 

5.  Inductive  Reasoning 

6.  Deductive  Reasoning 

7.  Memorization 

8.  Information  Ordering 

9.  Time-Sharing 

10.  Flexibility  of  Closure 

1 1.  Speed  of  Closure 

12.  Perceptual  Speed 

13.  Spatial  Orientation 


IMPORTANCE 
OF  ABILITY 


IF 

APPLICABLE 


ABILITIES 

PSYCHOMOTOR 

ABILITIES 

16. 

Static  Strength 

17. 

Finger  Dexterity 

18. 

Arm-Hand  Steadiness 

19. 

Multilimb  Coordination 

20. 

Choice  Reaction  Time 

21. 

Rate  Control 

IMPORTANCE 
OF  ABILITY 


IF 

APPLICABLE 


INTERPERSONAL 

ABILITIES 

22. 

Persuading/Influencing 

23. 

Cooperating 

24. 

Assuming  Responsibility 

25. 

Working  Effectively  in 
Isolation  Settings 

26. 

Working  Effectively  in 
Uncomfortable  Human 
Situations 

14.  Visualization 

15.  Originality 


27.  Empathy 

28.  Self-Assessing 


ACTION  VERB  (CODAP) 


0. 

1. 

2. 

3. 

4. 


5. 

6. 


7. 

8. 

9. 

10. 


IMPORTANCE-OF-ABILITY  SCALE 
(GIVEN  ADEQUATE  TRAINING  AND  EXPERIENCE) 


THE  HIGHEST  IMPORTANCE:  Less  than  10  percent  of  the  tasks  associated  with 
this  verb  can  be  correctly  completed  with  an  average  level*  of  this  ability. 

EXTREMELY  HIGH  IMPORTANCE:  About  10  percent  of  the  tasks  associated 
with  this  verb  can  be  correctly  completed  with  an  average  level  of  this  ability. 

VERY  HIGH  IMPORTANCE:  About  20  percent  of  the  tasks  associated  with  this 
verb  can  be  correctly  completed  with  an  average  level  of  this  ability. 

HIGH  IMPORTANCE:  About  30  percent  of  the  tasks  associated  with  this  verb  can 
be  correctly  completed  with  an  average  level  of  this  ability. 


SLIGHTLY  ABOVE  AVERAGE  IMPORTANCE:  About  40  percent  of  the  tasks 
associated  with  this  verb  can  be  correctly  completed  with  an  average  level  of  this 
ability. 

AVERAGE  IMPORTANCE:  About  50  percent  of  the  tasks  associated  with  this  verb 
can  be  correctly  completed  with  an  average  level  of  this  ability.  ^ 

SLIGHTLY  BELOW  AVERAGE  IMPORTANCE:  About  60  percent  of  the  tasks 
associated  with  this  verb  can  be  correctly  completed  with  an  average  level  of  this 
ability. 

LOW  IMPORTANCE:  About  70  percent  of  the  tasks  associated  with  this  verb  can 
be  correctly  completed  with  an  average  level  of  this  ability. 

VERY  LOW  IMPORTANCE:  About  80  percent  of  the  tasks  associated  with  this 
verb  can  be  correctly  completed  with  an  average  level  of  this  ability. 


EXTREMELY  LOW  IMPORTANCE:  About  90  percent  of  the  tasks  associated  with 
this  verb  can  be  correctly  completed  with  an  average  level  of  this  ability. 

THE  LOWEST  IMPORTANCE:  More  than  90  percent  of  the  tasks  associated  with 
this  verb  can  be  correctly  completed  with  an  average  level  of  this  ability. 


♦  AVERAGE  LEVEL  APPLIES  TO  THE  AVERAGE  LEVEL  OF  THIS 
ABILITY  FOUND  IN  THE  TYPICAL  COLLEGE  GRADUATE. 
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0. 

1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 


GWI  ELEMENT 

IMPQRTANCE-OF-ABILITY  SCALE 
(GIVEN  ADEQUATE  TRAINING  AND  EXPERIENCE) 


THE  HIGHEST  IMPORTANCE:  Less  than  10  percent  of  the  actions  needed  to 
perform  the  task  can  be  correctly  completed  with  an  average  level*  of  this  ability. 

EXTREMELY  HIGH  IMPORTANCE:  About  10  percent  of  the  actions  needed 
to  perform  the  task  can  be  correctly  completed  with  an  average  level  of  this 
ability. 

VERY  HIGH  IMPORTANCE:  About  20  percent  of  the  actions  needed  to 
perform  the  task  can  be  correctly  completed  with  an  average  level  of  this  ability. 

HIGH  IMPORTANCE:  About  30  percent  of  the  actions  needed  to  perform  the 
task  can  be  correctly  completed  with  an  average  level  of  this  ability. 

SLIGHTLY  ABOVE  AVERAGE  IMPORTANCE:  About  40  percent  of  the 
actions  needed  to  perform  the  task  can  be  correctly  completed  with  an  average 
level  of  this  ability. 

AVERAGE  IMPORTANCE:  About  50  percent  of  the  actions  needed  to  perform 
the  task  can  be  correctly  completed  with  an  average  level  of  this  ability. 

SLIGHTLY  BELOW  AVERAGE  IMPORTANCE:  About  60  percent  of  the 
actions  needed  to  perform  the  task  can  be  correctly  completed  with  an  average 
level  of  this  ability. 

LOW  IMPORTANCE:  About  70  percent  of  the  actions  needed  to  perform  the 
task  can  be  correctly  completed  with  an  average  level  of  this  ability. 

VERY  LOW  IMPORTANCE:  About  80  percent  of  the  actions  needed  to  perform 
the  task  can  be  correctly  completed  with  an  average  level  of  this  ability. 

EXTREMELY  LOW  IMPORTANCE:  About  90  percent  of  the  actions  needed 
to  perform  the  task  can  be  correctly  completed  with  an  average  level  of  this 
ability. 

THE  LOWEST  IMPORTANCE:  More  than  90  percent  of  the  actions  needed  to 
perform  the  task  can  be  correctly  completed  with  an  average  level  of  this  ability. 


*  AVERAGE  LEVEL  APPLIES  TO  THE  AVERAGE  LEVEL  OF  THIS  ABILITY 
FOUND  IN  THE  TYPICAL  COLLEGE  GRADUATE. 

B-4 

51 


^  "WSEtaSLji  ■  iisA"  iiJEt-S 


APPENDIX  C 

NINE-POINT  RATING  SCALES  FOR  VERBS  AND  GWI  ELEMENTS 


53 


ACTION  VERB  (CODAP) 


IMPORTANCE-OF-ABILITY  SCALE 
(GIVEN  ADEQUATE  TRAINING  AND  EXPERIENCE) 


9.  EXTREMELY  HIGH  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that 
is  very  much  higher  than  that  possessed  by  the  average  (person)  in  order  to  successfully 
perform  the  tasks  associated  with  this  verb. 

8.  VERY  HIGH  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that  is  much  { 
higher  than  that  possessed  by  the  average  (person)  in  order  to  successfully  perform  the 
tasks  associated  with  this  verb. 

7.  HIGH  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that  is  somewhat 
higher  than  that  possessed  by  the  average  (person)  in  order  to  successfully  perform  the 
tasks  associated  with  this  verb. 


6.  SLIGHTLY  ABOVE  AVERAGE  IMPORTANCE:  Individuals  need  a  level  of  this 
ability  that  is  slightly  higher  than  that  possessed  by  the  average  (person)  in  order  to 
successfully  perform  the  tasks  associated  with  this  verb. 

5.  AVERAGE  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that  is  about 
same  as  that  possessed  by  the  average  (person)  in  order  to  successfully  perform  the 
tasks  associated  with  this  verb. 

4.  SLIGHTLY  BELOW  AVERAGE  IMPORTANCE:  Individuals  need  a  level  of  this 
ability  that  is  slightly  lower  than  that  possessed  by  the  average  (person)  in  order  to 
successfully  perform  the  tasks  associated  with  this  verb. 

3.  LOW  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that  is  somewhat  lower 
than  that  possessed  by  the  average  (person)  in  order  to  successfully  perform  the  tasks 
associated  with  this  verb. 


2.  VERY  LOW  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that  is  much 
lower  than  that  possessed  by  the  average  (person)  in  order  to  successfully  perform  the 
tasks  associated  with  this  verb. 

1.  EXTREMELY  LOW  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that 
is  very  much  lower  than  that  possessed  by  the  average  (person)  in  order  to  successfully 
perform  the  tasks  associated  with  this  verb.  ^ 
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GWI  ELEMENT 


)  IMPORTANCE-OF-ABILITY  SCALE 

(GIVEN  ADEQUATE  TRAINING  AND  EXPERIENCE) 


9.  EXTREMELY  HIGH  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that 
is  very  much  higher  than  that  possessed  by  the  average  college  graduate  in  order  to 
correctly  complete  the  actions  needed  to  perform  this  task. 

8.  VERY  HIGH  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that  is  much 
higher  than  that  possessed  by  the  average  college  graduate  in  order  to  correctly 
complete  the  actions  needed  to  perform  this  task. 

7.  HIGH  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that  is  somewhat 
higher  than  that  possessed  by  the  average  college  graduate  in  order  to  correctly 
complete  the  actions  needed  to  perform  this  task. 

6.  SLIGHTLY  ABOVE  AVERAGE  IMPORTANCE:  Individuals  need  a  level  of  this 
ability  that  is  slightly  higher  than  that  possessed  by  the  average  college  graduate  in 
order  to  correctly  complete  the  actions  needed  to  perform  this  task. 

5.  AVERAGE  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that  is  about  the 
same  as  that  possessed  by  the  average  college  graduate  in  order  to  correctly  complete 
the  actions  needed  to  perform  this  task. 

4.  SLIGHTLY  BELOW  AVERAGE  IMPORTANCE:  Individuals  need  a  level  of  this 
ability  that  is  slightly  lower  than  ti-*’  :  possessed  by  the  average  college  graduate  in  order 
to  correctly  complete  the  actions  needed  to  perform  this  task. 

3.  LOW  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that  is  somewhat  lower 
than  that  possessed  by  the  average  college  graduate  in  order  to  correctly  complete  the 
actions  needed  to  perform  this  task. 

2.  VERY  LOW  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that  is  much 
lower  than  that  possessed  by  the  average  college  graduate  in  order  to  correctly  complete 
the  actions  needed  to  perform  this  task. 

1.  EXTREMELY  LOW  IMPORTANCE:  Individuals  need  a  level  of  this  ability  that 
is  very  much  lower  than  that  possessed  by  the  average  college  graduate  in  order  to 
correctly  complete  the  actions  needed  to  perform  this  task. 


